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DETAILED ACTION 



Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 25 July 
2005 has been entered. 

2. Claims 1-9 and 14-20 are pending in this application. Claims 1 and 18 are 
independent claims. In the Amendment filed 25 July 2005, claims 1 and 18 were 
amended. This action is non-final. 

Claim Rejections - 35 USC § 103 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 1, 3, and 14-20 are rejected under 35 U.S.C. 103(a) being unpatentable 
over U.S. Patent No. 5,893,095 issued to Jain et al. (hereafter Jain '095) in view of U.S. 
Patent No. 6,345,274 issued to Zhu et al. (hereafter Zhu '274). 

Claim 1: 

Regarding Claim 1 , Jain '095 discloses a content based image query engine. 
Specifically, Jain '095 discloses: a method of seeking images, from an example image 
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containing at least one region of interest (Jain '095: col. 4, Ins. 21-28; col. 35, Ins. 17-18 
- note that a portion of an image reads on a region of interest), from amongst a plurality 
of images stored in a database, each of the stored images being associated with a data 
item of a first type, referred to as an index of the stored image, representing at least one 
characteristic of the visual content of the image (Jain '095: Abstract; col. 3, In. 58 to col. 
4, In. 4), said method comprising the following steps: 

- for each region of interest, receiving a data item of a second type, indicative of a 
user selection (Jain '095: See Fig. 3 - 204, 206 & 208: User specifies primitive 
weight using slider) for a type of taking into account of the content of said region 
of interest for the seeking of images (Jain '095: col. 8, Ins. 6-15 & 35-55); 

- calculating a data item of a third type, referred to as the index of the example 
image, representing at least one characteristic of the visual content of the 
example image, the method of calculating said data item of the third type 
depending on said data item of the second type (Jain '095: col. 8, Ins. 17-20, 
note that a primitive may be a composite function); 

- calculating a similarity between the example image and each of the images 
amongst at least one subset of the stored images, said similarity being calculated 
from said data item of the first type associated with the stored image and the 
data item of the third type associated with the example image (Jain '095: col. 8, 
Ins. 20-35; col. 7, Ins. 9-23); and 

- supplying at least one image, referred to as the result image, in the database, 
said at least one result image being selected from amongst said stored images in 



Application/Control Number: 09/726,023 Page 4 

Art Unit: 2161 

the database according to its degree of similarity with said example image (Jain 
'095: col. 9, In. 64 to col. 10. In. 10). 
However, Jain '095 does not specifically disclose: 

- selecting an image research strategy according to said at least one data item of 
the second type; or 

- that the calculation of a similarity is according to the selected image research 
strategy. 

Zhu '274 discloses a means to determine a similarity measure in image retrieval. 
Specifically, Zhu '274 discloses: 

- selecting an image research strategy according to said at least one data item of 
the second type (Zhu '274: col. 7, Ins. 9-12; col. 8, Ins. 15-17 — note that 
similarity measures read on image research strategy, and that dependent on the 
type of indexing structure (e.g. bounding regions, color moments, etc.) the 
similarity measure is selected); or 

- that the calculation of a similarity is according to the selected image research 
strategy (Zhu '274: col. 7, Ins. 9-12; col. 8, Ins. 15-17). 

It would have been obvious to a person having ordinary skill in the art to apply 
the strategy selection means of Zhu '274 to the image retrieval of Jain '095. The 
motivation to combine is suggested by Zhu '274 which discloses: use of the strategy 
selection means of Zhu '274 provides the advantage of providing an automatic way to 
determine user preferences in an image retrieval system such as that of Jain '095 (Zhu 
'274: col. 3, Ins. 30-33). 
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Claim 3: 

Regarding Claim 3, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claim 1 (supra). Further note that Jain '095 and Zhu '274 in combination 
additionally disclose: wherein said data item of the first type, called index of the stored 
image, associated with each of said stored images, consists of a histogram, of colors 
relating to the global content of the image (Jain '095: col. 7, Ins. 50-53). 
Claim 14: 

Regarding Claim 14, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claim 1 (supra). Further note that Jain '095 and Zhu '274 in combination 
additionally disclose: wherein the selected image research strategy uses a 
measurement of similarly selected from amongst a plurality of possible measurements 
based on said at least one data item of the second type (Zhu '274: col. 7, Ins. 9-12; col. 
8, Ins. 15-17 - note that similarity measures read on image research strategy, and that 
dependent on the type of indexing structure (e.g. bounding regions, color moments, 
etc.) the similarity measure is selected). 
Claim 15: 

Regarding Claim 15, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claims 1 and 14 (supra). Further note that Jain '095 and Zhu '274 in 
combination additionally disclose: further comprising a step of receiving a data item of a 
fourth type representing the location of at least one region of interest in the example 
image (Jain '095: col. 35, Ins. 17-18). 
Claim 16: 
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Regarding Claim 16, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claim 15 (supra). Further note that Jain '095 and Zhu '274 in combination 
additionally disclose: wherein said data item of the fourth type representing the location 
of at least one region of interest in the example image consists of a set of two- 
dimensional points indicative of the shape of said at least one region of interest and its 
location in the image plane of said example image (Jain '095: col. 35, Ins. 17-18 - note 
that an image is two-dimensional and specifying a "portion of the image" as per Jain 
'095 includes indicating the shape and location of a region of interest). 
Claim 17: 

Regarding Claim 17, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claims 1 and 2 (supra). Further note that Jain '095 and Zhu '274 in 
combination additionally disclose: the device embodiment of said methods (Jain '095: 
col. 10, Ins. 11-40). 
Claim 18: 

Examiner notes the means plus function language in Claim 18. By applying the 
three prong test as specified in MPEP 2181, Examiner interprets Claim 18 as language 
falling under 35 USC 112, sixth paragraph. 

Regarding Claim 18, Jain '095 discloses a content based image query engine. 
Specifically, Jain '095 discloses a: device for seeking images, from an example image 
containing at least one region of interest (Jain '095: col. 4, Ins. 21-28; col. 35, Ins. 17-18 
- note that a portion of an image reads on a region of interest), from amongst a plurality 
of images stored in a database, each of the stored images being associated with a data 
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item of a first type, referred to as an index of the stored image, representing at least one 
characteristic of the visual content of the image (Jain '095: Abstract; col. 3, In. 58 to col. 
4, In. 4), said device comprising: 

- means for receiving, for each region of interest, a data item of a second type 
indicative of a user selection (Jain '095: See Fig. 3 - 204, 206 & 208: User 
specifies primitive weight using slider) for a type taking into account of the 
content of said region of interest for the seeking of images (Jain '095: col. 8, Ins. 
6-15 & 35-55); 

- means for calculating a data item of a third type, referred to as the index of the 
example image, representing at least one characteristic of the visual content of 
the example image and depending on said data item of the second type (Jain 
'095: col. 8, Ins. 17-20, note that a primitive may be a composite function); 

- means for calculating a similarity, between the example image and each of the 
images amongst at least one subset of the stored images, based on said data 
item of the first type associated with the stored image and on the date item of the 
third type associated with the example image (Jain '095: col. 8, Ins. 20-35; col. 7, 
Ins. 9-23); and 

- means for supplying at least one image, referred to as the result image, in the 
database, based on a selection from amongst said stored images in the 
database according to a degree of similarity of said result image with said 
example image (Jain '095: col. 9, In. 64 to col. 10. In. 10). 

However, Jain '095 does not explicitly disclose: 



Application/Control Number: 09/726,023 Page 8 

Art Unit: 2161 

- means for selecting an image research strategy according to said at least one 
data item of the second type; 

- calculation of the similarity is according to the selected research strategy. 

Zhu '274 discloses a means to determine a similarity measure in image retrieval. 
Specifically, Zhu '274 discloses: 

- means for selecting an image research strategy according to said at least one 
data item of the second type (Zhu '274: col. 7, Ins. 9-12; col. 8, Ins. 15-17 - note 
that similarity measures read on image research strategy, and that dependent on 
the type of indexing structure (e.g. bounding regions, color moments, etc.) the 
similarity measure is selected); or . 

- calculation of the similarity is according to the selected research strategy (Zhu 
'274: col. 7, Ins. 9-12; col. 8, Ins. 15-17). 

It would have been obvious to a person having ordinary skill in the art to apply 
the strategy selection means of Zhu '274 to the image retrieval of Jain '095. The 
motivation to combine is on the same basis as Claim 1 (supra). 
Claim 19: 

Regarding Claim 19, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claims 1 and 2 (supra). Further note that Jain '095 and Zhu '274 in 
combination additionally disclose: a computer comprising means embodiment of said 
methods (Jain '095: col. 10, Ins. 11-40). 
Claim 20: 
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Regarding Claim 20, Jain '095 and Zhu '274 in combination disclose all the 
limitations of Claims 17 and 18 (supra). Further note that Jain '095 and Zhu '274 in 
combination additionally disclose: a computer comprising an image search device 
according to Claims 17 and 18 (Jain '095: col. 10, Ins. 11-40). 

4. . Claims 1, 3, and 14-20 are rejected under 35 U.S.C. 102(e) as being anticipated 
by U.S. Patent No. 6,373,979 issued to Wang (hereafter Wang '979) and Zhu '274. 
Claim 1: 

Regarding Claim 1 , Wang '979 discloses a content based image query engine. 
Specifically, Wang '979 discloses: a method of seeking images, from an example 
image containing at least one region of interest (Wang '979: col. 4, Ins. 27-32 - note 
that attributes based on spatial characteristics read on a region of interest), from 
amongst a plurality of images stored in a database, each of the stored images being 
associated with a data item of a first type, referred to as an index of the stored image, 
representing at least one characteristic of the visual content of the image (Wang '979: 
Abstract, Fig. 5, Fig. 8A, col. 7, Ins. 10-12), said method comprising the following steps: 

- for each region of interest, receiving a data item of a second type, indicative of a 
user selection (Wang '979: col. 5, Ins. 22-39 - user specifies similarity threshold) 
for a type of taking into account of the content of said region of interest for the 
seeking of images (Wang '979: col. 4, Ins. 44-46 & col. 5, Ins. 22-39); 

- calculating a data item of a third type, referred to as the index of the example 
image, representing at least one characteristic of the visual content of the 
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example image, the method of calculating said data item of the third type 
depending on said data item of the second type (Wang '979: col. 5, Ins. 6-20, 
note the weighted similarity function); 

- calculating a similarity, between the example image and each of the images 
amongst at least one subset of the stored images, said similarity being calculated 
from said data item of the first type associated with the stored image and the 
data item of the third type associated with the example image (Wang '979: col. 

5, Ins. 22-30); and 

- supplying at least one image, referred to as the result image, in the database, 
said at least one result image being selected from amongst said stored images in 
the database according to its degree of similarity with said example image (Wang 
'979: Fig. 8A, col. 7, Ins. 21-23). 

However, Wang '979 does not specifically disclose: 

- selecting an image research strategy according to said at least one data item of 
the second type; or 

- that the calculation of a similarity is according to the selected image research 
strategy. 

Zhu '274 discloses a means to determine a similarity measure in image retrieval. 
Specifically, Zhu '274 discloses: 

- selecting an image research strategy according to said at least one data item of 
the second type (Zhu '274: col. 7, Ins. 9-12; col. 8, Ins. 15-17 - note that 
similarity measures read on image research strategy, and that dependent on the 
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type of indexing structure (e.g. bounding regions, color moments, etc.) the 

similarity measure is selected); or 
- that the calculation of a similarity is according to the selected image research 

strategy (Zhu '274: col. 7, Ins. 9-12; col. 8, Ins. 15-17). 

It would have been obvious to a person having ordinary skill in the art to apply 
the strategy selection means of Zhu '274 to the image retrieval of Wang '979. The 
motivation to combine is suggested by Zhu '274 which discloses: use of the strategy 
selection means of Zhu '274 provides the advantage of providing an automatic way to 
determine user preferences in an image retrieval system such as that of Wang '979 
(Zhu '274: col. 3, Ins. 30-33). 
Claim 3: 

Regarding Claim 3, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claim 1 (supra). Further note that Wang '979 and Zhu '274 in combination 
additionally disclose: wherein said data item of the first type, called index of the stored 
image, associated with each of said stored images, consists of a histogram, of colors 
relating to the global content of the image (Wang '979: col. 4, Ins. 44-45). 
Claim 14: 

Regarding Claim 14, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claim 1 (supra). Further note that Wang '979 and Zhu '274 in combination 
additionally disclose: wherein the selected image research strategy uses a 
measurement of similarly selected from amongst a plurality of possible measurements 
based on said at least one data item of the second type (Zhu '274: col. 7, Ins. 9-12; col. 
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8, Ins. 15-17 - note that similarity measures read on image research strategy, and that 
dependent on the type of indexing structure (e.g. bounding regions, color moments, 
etc.) the similarity measure is selected). 
Claim 15: 

Regarding Claim 15, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claims 1 and 14 (supra). Further note that Wang '979 and Zhu '274 in 
combination additionally disclose: further comprising a step of receiving a data item of a 
fourth type representing the location of at least one region of interest in the example 
image (Wang '979: col. 4, Ins. 27-36 - note that an image is two-dimensional and 
specifying the "attributes of the segments" as per Wang '979 reads on the shape and 
location of a region of interest). 
Claim 16: 

Regarding Claim 16, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claim 15 (supra). Further note that Wang '979 and Zhu '274 in 
combination additionally disclose: wherein said data item of the fourth type 
representing the location of at least one region of interest in the example image consists 
of a set of two-dimensional points indicative of the shape of said at least one region of 
interest and its location in the image plane of said example image (Wang '979: col. 4, 
Ins. 27-36 - note that an image is two-dimensional and specifying the "attributes of the 
segments" as per Wang '979 reads on the shape and location of a region of interest). 
Claim 17: 
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Regarding Claim 17, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claims 1 and 2 (supra). Further note that Wang '979 and Zhu '274 in 
combination additionally disclose: the device embodiment of said methods (Wang '979: 
col. 9, Ins. 4-10). 
Claim 18: 

Examiner notes the means plus function language in Claim 18. By applying the 
three prong test as specified in MPEP 2181, Examiner interprets Claim 18 as language 
falling under 35 USC 112, sixth paragraph. 

Regarding Claim 18, Wang '979 discloses a content based image query engine. 
Specifically, Wang '979 discloses a: device for seeking images, from an example image 
containing at least one region of interest (Wang '979: col. 4, Ins. 27-32 - note that 
attributes based on spatial characteristics read on a region of interest), from amongst a 
plurality of images stored in a database, each of the stored images being associated 
with a data item of a first type, referred to as an index of the stored image, representing 
at least one characteristic of the visual content of the image (Wang '979: Abstract, Fig. 
5, Fig. 8A, col. 7, Ins. 10-12), said device comprising: 

- means for receiving, for each region of interest, a data item of a second type 
indicative of a user selection (Wang '979: col. 5, Ins. 22-39 - user specifies 
similarity threshold) for a type taking into account of the content of said region of 
interest for the seeking of images (Wang '979: col. 4, Ins. 44-46 & col. 5, Ins. 22- 
39); 
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- means for calculating a data item of a third type, referred to as the index of the 
example image, representing at least one characteristic of the visual content of 
the example image and depending on said data item of the second type (Wang 
'979: col. 5, Ins. 6-20, note the weighted similarity function); 

- means for calculating a similarity, between the example image and each of the 
images amongst at least one subset of the stored images, based on said data 
item of the first type associated with the stored image and on the date item of the 
third type associated with the example image (Wang '979: col. 5, Ins. 22-30); 
and 

- means for supplying at least one image, referred to as the result image, in the 
database, based on a selection from amongst said stored images in the 
database according to a degree of similarity of said result image with said 
example image (Wang '979: Fig. 8A, col. 7, Ins. 21-23). 

However, Wang '979 does not explicitly disclose: 

- means for selecting an image research strategy according to said at least one 
data item of the second type; 

- calculation of the similarity is according to the selected research strategy. 

Zhu '274 discloses a means to determine a similarity measure in image retrieval. 
Specifically, Zhu '274 discloses: 

- means for selecting an image research strategy according to said at least one 
data item of the second type (Zhu '274: col. 7, Ins. 9-12; col. 8, Ins. 15-17 - note 
that similarity measures read on image research strategy, and that dependent on 
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the type of indexing structure (e.g. bounding regions, color moments, etc.) the 
similarity measure is selected); or 
- calculation of the similarity is according to the selected research strategy (Zhu 
'274: col. 7, Ins. 9-12; col. 8, Ins. 15-17). 

It would have been obvious to a person having ordinary skill in the art to apply 
the strategy selection means of Zhu '274 to the image retrieval of Wang '979. The 
motivation to combine is on the same basis as Claim 1 (supra). 
Claim 19: 

Regarding Claim 19, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claims 1 and 2 (supra). Further note that Wang '979 and Zhu '274 in 
combination additionally disclose: a computer comprising means embodiment of said 
methods (Wang '979: col. 9, Ins. 4-10). 
Claim 20: 

Regarding Claim 20, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claims 17 and 18 (supra). Further note that Wang '979 and Zhu '274 in 
combination additionally disclose: a computer comprising an image search device 
according to Claims 17 and 18 (Wang '979: col. 9, Ins. 4-10). 

5. Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over Wang 
'979 and Zhu '274 in view of U.S. Patent No. 6,230,154 issued to Raz et al. (hereafter 
Raz'154). 
Claim 2: 
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Regarding Claim 2, Wang '979 and Zhu '274 in combination disclose all the 
limitations of Claim 1 (supra). Further note that Wang '979 and Zhu '274 additionally 
disclose: wherein said data item of the second type, associated with a region of 
interest, is a scalar data item which can take all the values lying between a predefined 
lower value V min , and a predefined higher value V max , (Wang '979: col. 5, Ins. 22-39) 
and wherein: 

- if said data item of the second type, is equal to the predefined lower value V m j n , 
the content of the images sought must not be similar to the content of the 
corresponding region of interest (Wang '979: col. 5, Ins. 29-33); and 

- if said data item of the second type, is equal to the predefined higher value V m a X) 
the content of the images sought must be similar to the content of the 
corresponding region of interest (Wang '979: col. 5, Ins. 27-31). 

However, Wang '979 and Zhu '274 in combination do not explicitly disclose: 

- if said data item of the second type, lies strictly between the lower predefined 
value V min and the higher predefined value V ma x t the content of the images 
sought must be more or less similar to that of the corresponding region of interest 
depending on whether the value of said data item of the second type, is close to 
V max or is close to Vmin, the overall content of the example image also having to 
be taken into consideration. 

Raz '154 discloses a hyperbox that defines whether a retrieved item is similar. 
Specifically, Raz '154 discloses: 
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- if said data item of the second type, lies strictly between the lower predefined 
value V min and the higher predefined value V max , the content of the images 
sought must be more or less similar to that of the corresponding region of interest 
depending on whether the value of said data item of the second type, is close to 
Vmax or is close to V min , the overall content of the example image also having to 
be taken into consideration. 

- Raz '1 54 discloses a hyperbox that defines whether a retrieved item is similar 
(Raz'154: Ins. 14-27). 

It would have been obvious to a person having ordinary skill in the art to augment 
the similarity criteria of Wang '979 and Zhu '274 with the hyperbox of Raz '154. The 
motivation to accomplish said augmentation is suggested by Raz '154 which discloses 
that applying the hyperbox of Raz '1 54 provides a particularly advantageous way to 
view and conceptualize similarity relationships between database items (Raz '154: col. 
3, Ins. 23-38). 

6. Claims 4-9 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wang '979, Zhu '274, and Raz '154, in view of Jain '095. 
Claim 4: 

Regarding Claim 4, Wang '979, Zhu '274, and Raz '154 in combination disclose 
all the limitations of Claim 3 (supra). Further note that Wang '979, Zhu '274, and Raz 
'154 in combination additionally disclose that a condition can be set for: 
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- if all said data items of the second type are equal to said lower predefined value 
V m in, or if all said data of the third type are equal to said higher predefined value 
V max ; or 

- if each of said data of the second type is equal to V mi n or equal to V max (Raz '1 54: 
Ins. 14-27 - note the hyperbox of Raz '154 reads on this range setting) 

However, Wang '979, Zhu '274, and Raz '154 in combination do not explicitly disclose 
that the action taken on the above condition is: 

- said step of calculating a data item of a third type, called index of the example 
image, includes a step of calculating a vector, each component of which consists 
of the histogram of colors representing the visual content of one of said regions 
of interest, said vector constituting the index of said example image. 

Jain '095 discloses: 

- said step of calculating a data item of a third type, called index of the example 
image, includes a step of calculating a vector, each component of which consists 
of the histogram of colors representing the visual content of one of said regions 
of interest, said vector constituting the index of said example image (Jain '095: 
col. 8, Ins. 32-34 - note that the composite metric of Jain '095 reads on the index 
of Applicant). 

It would have been obvious to a person having ordinary skill in the art to set the 
composite metric of Jain '095 for the condition of Wang '979, Zhu '274, and Raz '154 in 
combination. The motivation to accomplish said setting is suggested by Jain '095 which 
discloses the necessity of combining into a composite metric different distance metric 



Application/Control Number: 09/726,023 Page 19 

Art Unit: 2161 

components of multiple primitives (i.e. computed statistical features of an image) (Jain 
'095: col. 8, Ins. 29-34). 
Claim 5: 

Regarding Claim 5, Wang '979, Zhu '274, Raz '154, and Jain '095 in combination 
disclose all the limitations of Claim 4 (supra). Further note that Wang '979, Zhu '274, 
Raz '154, and Jain '095 in combination additionally disclose: wherein if all said data of 
the second type are strictly between said lower predefined value V m j n and said higher 
predefined value Vm ax , then said step of calculating a data item of a third type, called 
index of the example image (Raz '154: Ins. 14-27 and Jain '095: col. 8, Ins. 29-34), 
includes the following steps: 

- calculating a matrix with M rows and M columns, where M is a integer number 
designating the number of colors available, each element of whose diagonal 
corresponds to one of the M colors available, each of the elements of the 
diagonal having a value which is calculated as a function of the dominant 
character of the color associated with said element in said at least one region of 
interest associated with said example image, and of said data item of the second 
type associated with said at least one region of interest (Wang '979: col. 4, In. 62 
to col. 5, In. 20 - note the "weighting matrix" of Wang '979); 

- calculating the histogram of colors representing the overall visual content of said 
example image (Wang '979: col. 4, In. 62 to col. 5, In. 20 - note the multiplication 
of the "weighting matrix" with the "histograms representing the color 
characteristics" of Wang ( 979); and 
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- defining said index of the example image as being the result of the product of 
said matrix and said histogram of colors representing the overall visual content of 
said example image (Wang '979: col. 4, In. 62 to col. 5, In. 20 - note the use of 
the multiplication of the "weighting matrix" with the "histograms representing the 
color characteristics" for a "weighted similarity function" of Wang '979). 
Claim 6: 

Regarding Claim 6, Wang '979, Zhu '274, Raz '154, and Jain '095 in combination 
disclose all the limitations of Claim 5 (supra). Further note that Wang '979, Zhu '274, 
Raz '154, and Jain '095 in combination additionally disclose: when said data of the 
second type are not all equal to said lower predefined value V min , and are also not all 
equal to said higher predefined value V max , and are also not each equal either to V min or 
to V max , and also not all strictly between V min and V max (Raz '154: Ins. 14-27 - note the 
hyperbox of Raz '1 54), said index of the example image consists of the result of the 
product of said matrix and said histogram of colors representing the overall visual 
content of said example image, and of said vector (Wang '979: col. 4, In. 62 to col. 5, 
In. 20 - see discusion in Claim 5 (supra)), each component of which consists of the 
histogram of colors representing the visual content of one of said regions of interest 
(Wang '979: col. 5, Ins. 4-5; col. 4, Ins. 28-32 - note the "segments" of Wang '979 read 
on regions of interest). 
Claims 7-9: 
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Regarding Claims 7-9, Wang '979, Zhu '274, Raz '154, and Jain '095 in 
combination disclose all the limitations of Claim 6 (supra). Further note that Wang '979, 
Zhu '274, Raz '154, and Jain '095 in combination additionally disclose: 

- (Claim 7) said step of calculating a similarity between the example image and 
each of the images amongst at least one subset of the stored images, includes 
the step of calculating a similarity, denoted SIMi, obtained by means of the 
following formula: 

SIMi(D) = Max [ H M (D) > H M (ROI r S0 ) ] 
in which Hm(D) designates a histogram of colors calculated for the stored image 
under consideration; ROI r S0 designates any region of interest in the example 
image for which the associated data item of the second type, is equal to V min ; H M 
(ROI r S0 ) designates a histogram of colors calculated for this region of interest; the 
operator > designates the intersection operation between histograms; and the 
function Max takes the largest value obtained by these intersections (Wang '979: 
col. 7, In. 24 to col. 8, In. 18). 

- (Claim 8) said step of calculating a similarity between the example image and 
each of the images amongst at least one subset of the stored images, includes 
the step of calculating a similarity, denoted SIM 2j obtained by means of the 
following formula: 

SIM 2 (D) = Max [ Hm(D) z H m (ROI r s1 ) J 
in which H M (D) designates a histogram of colors calculated for the stored image 
under consideration; ROI r S0 designates any region of interest in the example 
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image for which the associated data item of the second type, is equal to V max ; H M 
(ROI r s1 ) designates a histogram of colors calculated for this region of interest; the 
operator ;> designates the intersection operation between histograms; and the 
function Max takes the largest value obtained by these intersections (Wang '979: 
col. 7, In. 24 to col. 8, In. 18). 
- (Claim 9) said step of calculating a similarity between the example image and 
each of the images amongst at least one subset of the stored images includes 
the step of calculating a similarity, denoted SIM 3l obtained by means of the 
following formula: 

SIM 3 (D) = H M (D) * X(Q) with X(Q) = W • H M (Q) 
in which H M (D) designates a histogram of colors calculated for the stored image 
under consideration; W designates said matrix; H M (Q) is a histogram of colors 
representing the global visual content of said example image; and the operator n 
designates the intersection operation between histograms (Wang '979: col. 7, In. 
24 to col. 8, In. 18). 

Note that the combination of Wang '979, Zhu '274, Raz '154, and Jain '095 
provide for use of appropriate similarity function as required by the user (Wang '979: 
col. 7, In. 32 and Jain '095: col. 8, Ins. 20-55) and moreover provide for the elements to 
calculate the similarity function and conditions for the similarity functions of Claims 7-9. 
A person having ordinary skill in the art, faced with the problem of creating an 
appropriate similarity function as applicable per Claims 7-9 would reasonably expected 
to infer the similarity functions as per Claims 7-9 (see MPEP 2144.01). 
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Response to Arguments 

7. Applicant's arguments with respect to claims 1-9 and 14-20 have been 
considered but are moot in view of the new ground(s) of rejection. 

Referring to applicant's remarks on pages 10-12 regarding the Section 103 
rejections oyer Jain in view of Zhu: Applicant argued that neither Jain nor Zhu disclose 
"receiving a data item of a second type indicative of a user selection for a type of taking 
into account of the content of said region of interest for the seeking of images" as 
recited in amended claims 1 and 18. 

The examiner disagrees for the following reasons: As shown in Jain: Figure 3; 
Box 204, a user selects weights to be applied to each primitive via the sliders 208. This 
user selection of weights for each primitive is "receiving a data item of a second type 
indicative of a user selection for a type of taking into account of the content of said 
region of interest for the seeking of images" as recited in amended claims 1 and 18. 
Thus, the combination of Jain and Zhu obviates the claims, even as amended. 

Referring to applicant's remarks on pages 13-14 regarding the Section 103 
rejections over Wang in view of Zhu: Applicant argued that neither Wang nor Zhu 
disclose "receiving a data item of a second type indicative of a user selection for a type 
of taking into account of the content of said region of interest for the seeking of images" 
as recited in amended claims 1 and 18. 

The examiner disagrees for the following reasons: Wang teaches the claimed 
receiving in Column 5, lines 22-39. Namely, Wang's user selects a similarity threshold 
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to be taken into account in calculating similarity for each region/image. This user 
selection of a similarity threshold is considered "receiving a data item of a second type 
indicative of a user selection for a type of taking into account of the content of said 
region of interest for the seeking of images" as recited in amended claims 1 and 18. 
Thus, the combination of Wang and Zhu obviates the claims, even as amended. 



8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brian Goddard whose telephone number is 571-272- 
4020. The examiner can normally be reached on M-F, 9 AM - 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Safet Metjahic can be reached on 571-272-4023. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Conclusion 
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